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Abstract. In random allocation rules, typically first an optimal frac¬ 
tional point is calculated via solving a linear program. The calculated 
point represents a fractional assignment of objects or more generally 
packages of objects to agents. In order to implement an expected as¬ 
signment, the mechanism designer must decompose the fractional point 
into integer solutions, each satisfying underlying constraints. The result¬ 
ing convex combination can then be viewed as a probability distribution 
over feasible assignments out of which a random assignment can be sam¬ 
pled. This approach has been successfully employed in combinatorial 
optimization as well as mechanism design with or without money. 

In this paper, we show that both finding the optimal fractional point as 
well as its decomposition into integer solutions can be done at once. We 
propose an appropriate linear program which provides the desired solu¬ 
tion. We show that the linear program can be solved via Dantzig-Wolfe 
decomposition. Dantzig-Wolfe decomposition is a direct implementation 
of the revised simplex method which is well known to be highly efficient in 
practice. We also show how to use the Benders decomposition as an alter¬ 
native method to solve the problem. The proposed method can also find 
a decomposition into integer solutions when the fractional point is read¬ 
ily present perhaps as an outcome of other algorithms rather than linear 
programming. The resulting convex decomposition in this case is tight in 
terms of the number of integer points according to the Caratheodory’s 
theorem. 

Keywords: Mechanism design. Random allocation. Convex decompo¬ 
sition, Dantzig-Wolfe decomposition. Benders decomposition 


1 Introduction 

The technique of finding a fractional solution, and decomposing it into polynomially- 
many integer points has been successfully employed in many problems. For a 
usage of the technique in combinatorial optimization, for instance, see Carr and 
Vempala [1]. In mechanism design with bidders who have quasi-linear valua¬ 
tions, the framework presented by Lavi and Swamy for designing truthful and 
approximate mechanisms strongly relies on this technique mm- Perhaps the 
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best connection between linear programming and algorithmic mechanism design 
has been established by this framework. Finally, for applications in mechanism 
design without money see e.g. Budish et al. [3], and Nguyen et al. [14]. 

Typically in such applications, first a fractional optimal point is calculated, 
and in a second step, the point is represented as a convex combination of integer 
points usually using the ellipsoid method. A subroutine or an approximation 
algorithm which returns an integer point with respect to any cost vector is em¬ 
ployed to construct the separation oracle for the ellipsoid method. A separation 
oracle, in the ellipsoid method, states if a given point is feasible, or in case it 
is not feasible, the oracle returns a violated constraint. A natural question that 
arises here is to ask if the two steps, optimization as well as convex decomposi¬ 
tion, can be done at once without employing the ellipsoid method? 

1.1 Results and Techniques 

We propose an appropriate linear program for finding an optimal fractional point 
and its decomposition into integer points. We show how to use the Dantzig- 
Wolfe decomposition which is based on the revised simplex to solve the linear 
program. More specifically, we show that finding a convex combination of integer 
points whose value is maximum is indeed equivalent to solving a linear program 
using the Dantzig-Wolfe decomposition. The proposed method will improve the 
connection between linear programming and algorithmic mechanism design. 

Dantzig-Wolfe (DW) decomposition comprises a master problem and a suh- 
prohlem. DW decomposition proceeds in iterations by solving the two problems 
in each iteration until the subproblem is not able to find any point which can 
contribute to the objective value of the master problem [5]. Since we are in¬ 
terested in integer points, we run a subroutine or an approximation algorithm 
which returns integer solutions as the subproblem. DW decomposition has been 
previously used for optimizing over a discrete set using branch and cut to ob¬ 
tain integer solutions |6]. However, here we assume the existence of a subroutine 
which returns an approximate integer solution of good quality and prove that 
the algorithm ends in optimality. To the best of our knowledge, this usage of 
DW decomposition in mechanism design has not been introduced before. 

Dantzig-Wolfe decomposition is a variant of the revised simplex algorithm. 
A computational evaluation of the Dantzig-Wolfe decomposition has been done 
in m- The study shows DW decomposition has a high performance, especially 
when a reasonable block structure can be found. 

The convex combination calculated by our method is tight in terms of the 
number of integer solutions according to the Caratheodory’s theorem provided 
that the number of constraints representing the underlying polytope is less than 
the dimension of the polytope. We explain this fact further in the following. 

Theorem 1 (Caratheodory). Given a polytope in K”, any point in the poly¬ 
tope is a convex combination of at most n -I- 1 vertices of the polytope. 

By standard polyhedra theory, the number of nonzero variables in an extreme 
point is upper bounded by the number of constraints in the underlying linear 
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program (see e.g. [^). The proposed algorithm produces a convex combination 
of at most m + 1 integer points, where m is the number of constraints, and 
thus the solution is tight in this sense. It is very common that the number 
of constraints m is less than the number of variables n. For example, in the 
relaxations of combinatorial auctions, this is usually the case because the bidders 
may obtain any package of items (for which one decision variable is needed) and 
there are exponentially many packages of items. Thus, given that m < n, the 
number of integer solutions will be at most n + 1 which is tight according to the 
Caratheodory’s theorem. 

Sometimes, a fractional point - not necessarily an optimum - is calculated via 
other methods rather than linear programming. For example, a greedy a^orithm 
might be used to find a fractional point. This is because truthfulnesai\ can be 
guaranteed via the greedy algorithm, but directly solving the linear program 
cannot assure truthfulness (see e.g. 0). Our method can find a decomposition 
into integer solutions for such readily-present fractional points. 

We also show how to apply the Benders decomposition to the problem. Ben¬ 
ders decomposition is known to be the dual of the Dantzig-Wolfe decomposition 
technique [2]. We observe that sometimes working with the Benders decompo¬ 
sition has advantages over the DW decomposition. We discuss these advantages 
further in a separate section of the paper. 


1.2 Related Literature 

Prior to this work, there have been other attempts to replace the ellipsoid in 
finding convex decompositions. An alternative method is given by Kraft et al. 
m . The main component of that work is an algorithm which is based on a simple 
geometric idea that computes a convex combination within an arbitrarily small 
distance e > 0 to the fractional point. Our proposed method has advantages 
over the result in m- First, the size of the convex decomposition (number of 
integer solutions) is strictly smaller than the size of the convex decomposition 
produced by the method in m- The size of the convex decomposition in m 
might be as large as 0(s^e ^), where s is the number of nonzero components of 
the fractional point, and e > 0. Our solution will have a size of at most s -I- 1. 

Second, our decomposition is exact and does not suffer from an e > 0 com¬ 
promise in the solution. However, we provide no theoretical upper bound on 
the number of iterations, and the proposed method relies on the performance of 
Dantzig-Wolfe decomposition in practice. 

Elbassioni et al. present an alternative method for finding a convex decom¬ 
position of a given fractional point [9] . Their method relies on the multiplicative 
weights update method which is a general technique for solving packing and 
covering problems w. While the algorithm presented in [3] has a theoretical 
upper bound on the number of iterations, the algorithm is inferior to the pre¬ 
sented method here in two aspects. First, their convex decomposition might have 

^ Truthfulness is a desired property in algorithmic mechanism design, and assures that 
no bidder would benefit from reporting false valuations. 
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a size (the number of integer solutions) of s([e“^lns] + 1), s being the number 
of nonzero components of the fractional point, and e > 0. As mentioned earlier, 
our solution will have a size of at most s + 1. Second, their convex decomposition 
can be as precise as times the fractional solution (for some e > 0) at the 
expense of increasing runtime, while our convex decomposition is exact. 

1.3 Structure 

In Section [51 we formally introduce the setting of the problem. In Section |31 
we provide a short summary of DW decomposition technique. In Section |4l we 
establish our main result and show how the DW principle can be applied to our 
setting. Section|5]is devoted to the Benders decomposition applied to our setting. 
Section discusses two applications of the adapted DW principle. Finally, in 
Section [71 we provide a numerical example for the adapted DW technique. 

2 Setting 

Consider a finite set of integer points in Z". Let Q denote the convex hull of 
all these points. That is Q defines a polytope with integral extreme points. Let 
P = {x G R” I Ax < b & a; > O} denote a polytope, where A is an to by 
n matrix, and b an m-dimensional column vector. A subroutine A for any cost 
function c G M” returns an integer point X S Q such that cX > cx* , where 
X* = argmaxjca; \ x G P}. Equivalently, we say subroutine A will return for 
any cost vector c an integer point X S Q such that cX > cx for any x in P. Let 
I denote the index set for integer points in Q. The set of integer points in Q is 
therefore 

Usually, subroutine A only accepts non-negative cost vectors. Examples are 
approximation algorithms for NP-hard optimization problems. Eor instance, the 
approximation algorithm provided for the knapsack problem works with non¬ 
negative profits of items. However, in our setting, we expect A to work with any 
arbitrary cost vector. In such cases, an assumption that Q is a packing polytope 
is required: if x G Q and y < x then y G Q. See Lavi and Swamy for more 
information Ca¬ 
in this paper, we address the following problem. Given a cost vector c > 
0, find values {A* > O} such that i) **) I ^ 

X, A* > 0}| is polynomial in to and n, and in) where 

X* = argmaxjca; | x G P}. 

Using the ellipsoid method, it can be shown that every point in P can be 
written as a convex combination of the extreme points in Q [4113] . In this work, 
aside from answering the question above, we give an alternative proof for this 
fact. 

3 Summary of Dantzig-Wolfe Decomposition 

Dantzig-Wolfe decomposition belongs to column generation techniques. We shall 
here briefly go over the Dantzig-Wolfe Decomposition. Eor a detailed explanation 
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of the method we refer the reader to [2]- Consider the following linear program. 

Minimize cx 
subject to Ax = b 
X e X 

Where X is a bounded polyhedral of special structure, A is a to x n matrix, 
c is a n-dimensional vector and b is a m-dimensional vector. 

Since A is a bounded polyhedra, then any point x G X can be represented as 
a convex combination of a finite number of extreme points of X. Let us denote 
these points by Xi,X 2 , ■ ■ ■ ,xi, and substitute x with its convex combination 
of extreme points, then the aforementioned LP can be transformed into the 
following program in which the variables are Ai, A 2 ,..., A;. 


i 


Minimize ( cXj ) Xj 

(1) 



1 

subject to ''^{Axj)Xj = b 

(2) 



1 

(3) 



II 

0 

Al 

(4) 


The linear program (1) — (4) is called the master problem and the program 
which finds an appropriate x € X in each iteration is called the subproblem. 
Since the number of extreme points of set X is exponentially many, we follow 
the idea of column generation to find appropriate extreme point in each iteration. 
The information is passed back and forth between the master problem and the 
subproblem as follows. In each iteration a different cost coefficient is passed down 
by the master problem to the subproblem and the subproblem finds an extreme 
point Xk^ and sends it to the master problem. 

Dantzig-Wolfe decomposition is an implementation of the revised simplex 
method. Let vector w and a denote the dual variables corresponding to equations 
@ and ©, respectively. We first need an initial solution to generate the simplex 
tableau. Suppose we have a basic feasible solution A = {Xb,^n) to system 
(2) —(4), where \b and Xn denote the basic and nonbasic variables, respectively. 
The initial (to-|- 1) x (to-|- 1) basis inverse hence will be known. The cost for 
each basic variable Xj is in fact cj = cxj. Therefore, we get {w,a) = cbB~^, 


where cb is the cost vector of the basic variables. Denoting b = B 


we 


see the revised simplex tableau in Table [TJ 

The revised simplex proceeds by improving the current solution via finding 
an entering and a leaving variable. In other words, the set of basic and nonbasic 
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BASIS RHS 


{w,a) 

csb 

B ^ 

b 


Table 1. Simplex tableau. RHS stands for right-hand side. 


variables exchange one element. When such an exchange is not possible then the 
current solution is optimal. The entering variable is in fact a variable Xk associ¬ 
ated with extreme point Xk for which Zk — Ck > 0, where Zk = {w,a) 
and Ck = cxk- 

We observe that Zk — Ck = {wA — c)xk + a denotes the value of point Xk 
with respect to current costs wA — c and dual variable a. In order to find such 
a point, we solve the following subproblem which gives us the required index or 
tells that the current solution is optimal when the maximum value is zero. 



Maximize {wA — c)x + a 
subject to X £ X 


Notice that the objective function contains a constant and therefore it can be 
replaced by {wA — c)x. Assuming that Xk is the optimal solution to the program 
above, the revised simplex method goes on as follows. If Zfe — Cfe = 0 then the 
algorithm stops and the last solution to the master problem is an optimal of the 
overall problem. 


If Zfc — Cfc > 0 the master problem proceeds as follows. Let yk = B 


( Axk 
\ 1 


the entering column then will be y order to hnd the leaving column, 

let index r be determined as follows: 


br . . \ bi 

- = Minimum < - : yik > 0 

Vrk l<i<m-|-l yik 

We pivot at yrk which will update the dual variables, the basis inverse, and the 
right-hand side. More specifically, pivoting on y^k can be stated as follows. 

1. Divide row r by yrk- 

2. For i = I,.. .m and i ^ r, update the ith row by adding to it —yik times 
the new rth row. 

3. Update row zero by adding to it Zk — Ck times the new rth row. 

After pivoting, the column Xk is deleted and the algorithm repeats. 

An important observation about the DW principle is as follows. The DW 
principle expects the Subproblem to return any point x £ X where (wA — 
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c)x + a > 0 and it does not impose any other specific requirement on the 
selected point. We shall use this observation in our adaptation of the method. 

Another observation is that, in each iteration, the master program hnds the 
best solution using known extreme points. This is done in an organized manner 
as described above. 

4 Applying Dantzig-Wolfe Decomposition 

A wide range of combinatorial optimization problems can be formulated using 
the integer program max {ex \ x G P and integer}. Recall, P = {x £ R” | Ax < 
b & X > O}. For example, in combinatorial auctions, c denotes the accumulated 
valuations of the players, and the integer program therefore expresses the welfare 
maximization objective subject to feasibility constraints encoded as P. 

Usually, using simplex method or other standard linear programming tech¬ 
niques, first a relaxed linear program of the integer program above is solved: 


Maximize 

cx 

(5) 

subject to 

Ax < b 

(6) 


X > 0 

(7) 


Notice, constraints and o together are equivalent to x £ P. Next, the 
solution is rounded to an integer solution at the expense of a value loss or slightly 
violating the constraints. Given subroutine A, we wish to find a solution to the 
linear program above as well as a convex decomposition of it into integer points. 
We wish to achieve both goals at once. Recall, subroutine A returns for any cost 
vector c an integer point X £ Q such that cX > cx for any x in P. 

Generally speaking, Dantzig-Wolfe principle uses the fact that if we relax 
some constraints and obtain a simpler polyhedra then the solution to the orig¬ 
inal problem can be written as a convex combination of extreme points of the 
simpler polyhedra. The simplicity refers to the fact that the extreme points of 
the new polyhedra can be found more easily than those of the original prob¬ 
lem. While Dantzig-Wolfe principle is useful when the underlying constraints 
are decomposable into simpler regions, we use it in a slightly different manner 
by looking at Q as the polyhedra over which we can efficiently optimize. Recall, 
Q denotes the convex hull of a finite set of integer points. To apply the idea of 
Dantzig-Wolfe decomposition to the problem (5) — (7), we add a new constraint 
to the program. 


X £ Q (8) 

We will show that an optimal solution to problem (5) — (8) is also an optimal 
solution to (5) —(7), and thus adding the new constraint is harmless. We represent 
X £ Q as a convex combination of extreme points of Q. Recall, I denote the 
index set for integer points in Q, and is the set of integer points in Q. 
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Substitute x with its convex combination of extreme points of Q, then program 
(5) — (8) can be transformed into the following program where the variables are 




Maximize y^(cXj)Aj 

(9) 

J6I 


subject to ^(AXj)Aj + s = b 

(10) 

J6I 


E^2=1 

(11) 

J6I 


Aj >0 Vj £X 

(12) 

s > 0. 

(13) 


The linear program (9) — (13) is the master problem. Notice, we have added 
slack variables s £ R™ to convert the inequalities into equality as needed by the 
DW principle (see Section [S]). The DW subproblem is defined below. 


max (c + wA)lKj (14) 

162: 

While our problem is a maximization problem, the procedure in Section [3] 
is presented for a minimization problem, thus we substitute the — c with c in 
the objective function of the subproblem. That means, we change the objective 
function of the master problem from max^^-g 2 :(cXj)Aj to min^^g 2 :(~cXj)Aj, 
and apply the theory provided in Section [S] 

We assume 0 £ Q thus the initial basic solution is simply defined by letting 
Ao, the variable corresponding to point X = 0, equal 1 (Aq = 1), and letting 
s = bH Assuming that program (14) can be efficiently solved for any cost vector, 
then we are exactly following the DW principle, and therefore, we can successfully 
solve the overall problem as DW principle does this. However, program (14) is 
an integer program and solving it may not be computationally tractable. 

To address this issue, we propose using subroutine A to approximate program 
(14). Let {w,a) be the last dual variables calculated by the master program. In 
each iteration, we call subroutine A with current cost vector c + wA to find a 
point Xfc £ Q to pass to the master problem. This substitution seemingly comes 
at the expense of stopping at a local optimum, as explained in the following. 

As long as the algorithm continues by using the points returned by subroutine 
A, we are exactly running DW principle. Recall the important observation that 
in DW principle, the subproblem need not be completely optimized and any 
point Xfe with (c + wA)'Kk + d > 0 suffices to proceed. However, there might 
be an iteration in which there exists a point X.' £ Q for which we have (c + 
wA)X' + a > 0, but for the integer point X^ returned by subroutine A, we have 

^ Note that 0 £ Q is a consequence of the assumption that Q is a packing polytope. 
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{c + wA)'Kk + a < 0. Therefore, DW stops at a suboptimal point. Nevertheless, 
below, we argue that this cannot happen. That means as long as DW has not 
reached the optimum to problem (5) — (7), subroutine given the current cost 
vector (c + wA)^ returns a point X*, with (c + wA)X.k + d > 0. 

Let X* denote the optimal solution to program (5) — (7). It is instructive to 
see what the master step would do if the subproblem passes the point x* , rather 
than an integer point, to the master problem. While we do not know such an 
optimal point, but we know that such a point exists and this suffices for our 
reasoning. We argue that the master step will set = 1 and Xj — 0 for all 
other Aj’s which are currently in the base. In other words, the master program 
returns the best possible convex combination which is in fact A^* = 1. This is 
discussed in the following observation. 

Observation 1 Let x* denote the optimal solution to program (5) — (7). If 
supposedly the subproblem in any iteration passes x* to the master problem, 
then the master step will set X^* = 1 and Xj = 0 for all other Xj’s whieh are 
currently in the base. 

Proof. First, we observe that if the first subproblem (right after the initializa¬ 
tion) passes X* to the master problem, then the master step will set A^,. = 1 
and Aq = 0. Clearly, in the solution s needs to be evaluated accordingly. Second, 
by looking more closely at what simplex does in each iteration, we observe that 
in any further iteration, if the subproblem passes x* to the master problem, the 
master step will set A^,. = 1 and Xj — 0 for all other Aj’s. 

The simplex method, in each iteration, performs a set of row operations on 
the constraints when it pivots (see pivoting steps in Section [3|). The constraints, 
in any iteration, are thus the initial constraints after a series of row operations. 
This will certify that the aforementioned solution (A^,. = 1) will be feasible in 
any further iteration. If the subproblem passes x* to the master problem, our 
entering variable will be A^,*. The simplex algorithm then increases the entering 
variable A^,* as much as one basic variable gets zero. However, as discussed, the 
solution Aa;» = 1 is feasible, and it is possible to increase A^,* up to 1 and set 
all other A_, ’s to zero. The algorithm will behave as such to produce the highest 
increase in the objective value, the desired conclusion. 

Theorem 2. If the subproblem (14) calls subroutine A to return an integer point 
in each iteration, the DW principle never stops until it gets to an optimal solution 
to problem (5) — (7). 

Proof. Let x* denote the optimal solution to program (5) — (7). Assume the 
algorithm stops at a suboptimal point: ^ - (^jd) be 

the last dual variables calculated by the master program. Let be the point 
returned by subroutine A, given cost vector (c -|- wA), in the last iteration. We 
must have (c -|- wA)iKk -I- d < 0 because DW has stopped. 

If supposedly the subproblem in the last iteration passes a:* to the master 
problem, according to Observation [TJ the master step will increase A^,* up to 
1 and set all other Aj’s to zero. Since we assumed the algorithm has stopped 
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at a suboptimal point, by setting A^* = 1 the objective value will increase. If 
entering A^,* improves the objective value, we must have (c + wA)x* + a > 0 
from the theory of DW principle provided in Section |3j if (c + wA)x* + d < 0 
then entering variable A^* cannot improve the objective value. 

By the property of the subroutine, we have (c + wA)'Kk > (c + wA)x*. 
Thus, in the last iteration, we must have (c + wA)'Kk + d > 0. This contradicts 
our assumption that (c + wA)Xk + d < 0. Consequently, as long as we have not 
reached the optimum, the subroutine returns a point with (c + ibAjXfe +d > 
0. This completes the proof. 

We draw the conclusion that substituting program (14) with subroutine A is 
harmless. Therefore, we have shown that finding a convex decomposition of max¬ 
imum value is indeed equivalent to solving a linear program via DW principle. 
Let us call the method integer DW. 

5 Benders Decomposition 

It is known that the Dantzig-Wolfe Decomposition has an equivalent decompo¬ 
sition technique namely Benders decomposition [5]. Benders decomposition is a 
row generation technique in contrast with the Dantzig-Wolfe column generation 
procedure. Sometimes, working with Benders decomposition has advantages over 
Dantzig-Wolfe decomposition. We explain how to apply the Benders algorithm 
to our problem. Later, we discuss the advantages of the method. 

Recall, polytope Q is a bounded polyhedra. Hence, there exist matrix D G 
ffi.™ xn ^ g ]^m Q _ jg. g | ^ & a; > o}. We add 

constraint x £ Q io program (5) — (7) and work with the new program. We 
will see that adding this constraint has no influence on the region of feasible 
solutions to program (5) — (7). Following the standard procedure [5], we can 
write the Benders decomposition for this new program. The Benders master 


problem will be as follows. 

Maximize z (15) 

subject to z < wb — (c -f wA)'X.j Vj G X (16) 

m < 0 (17) 

z unrestricted. (18) 


The variables of the master problem are z and w. Variable vector w is the 
vector of dual variables associated to the constraints ®. The Benders master 
problem has exponentially many constraints, thus it is inconvenient to solve 
directly. Hence, we maintain only a few of the constraints (fTBl) . Assuming 0 G Q, 
we start with only one constraint: z < wb — (c -|- wA)0 — wb. Notice, we can 
use any X^ G Q to start with. We solve the master problem and let (z, w) be 
the solution. The value of z is an upper bound on the optimal value to the 
master problem. If (z, w) satisfies constraints (IT51) for all j G X, then (z, w) is 
optimal for the master problem. We can check constraints (HU) by examining if 
z < wb — maxjgx(c -I- wA)'Kj. 
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Thus, the Benders subproblem will be as the following. 

max (c + wA)X.j (19) 

Note that the Benders subproblem is also the subproblem solved by the 
Dantzig-Wolfe decomposition. Furthermore, the Benders master problem is the 
dual to the Dantzig-Wolfe master problem (9) — (13). The Benders subproblem, 
in each iteration, is solved by calling subroutine A with cost vector c+wA. If the 
subproblem returns that violates the constraints (IT6)) : z > wb— {c + wA)li.k, 
we can generate the new constraint z < wb — {c + wA)Xk, and add it to 
the current master program, and reoptimize. We repeat this process until the 
solution returned by subroutine A does not violate the constraints. We claim 
that at this iteration, the value of z is the optimal value to the master problem. 

The Benders decomposition provides a more concise proof that the decom¬ 
position techniques in companion with the subroutine A work correctly. 

Theorem 3. If the subproblem ilfA) calls subroutine A to return an integer point 
in each iteration, the Benders algorithm never stops until it reaches an optimal 
solution to problem (5) — (7). 

Proof. Let x* denote an optimal solution to problem (5) — (7). Let z* denote 
an optimal value of the Benders master problem. We have z* = {—c)x* by 
the construction of the Benders master problem, and the duality theorem. Let 
z be the final solution to the master problem and the solution returned 
by subroutine A when the Benders algorithm stops. Since the algorithm stops, 
we must have z < wb — (c -|- wA)'Kk. We always have z* < z because z is 
an upper bound on the optimal solution to the master problem. Assume z is 
not optimal: z > z*. Remember, by the definition of subroutine A, we have 
(c -I- wA)X.k > (c -I- wA)x*. Therefore, 


Ax* 

< 

b 

wAx* 

> 

wb 

—cx* 

> 

wb 

—cx* 

> 

wb 

z 

> 

wb 


since a:* is a solution to 
problem (5) — (7) 
since w < 0 


wA)Xk since z > z* = —cx* 


But, this contradicts z < wb — (c + wA)Xk. The contradiction arises from 
the assumption that z is not optimal. Thus, when the algorithm stops, we have 
the optimal solution, the desired conclusion. 

After solving the Benders master problem, we can use the provided integer 
solutions and solve the restricted primal to obtain a convex decomposition. 

Another advantage of the Benders decomposition arises from the fact that in 
each iteration, we optimize an LP in the master step. Solving an LP is sometimes 
more convenient than the implementation of the pivoting steps done in each 
iteration in the master step of the DW principle. 
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5.1 Polynomial Runtime Using Ellipsoid 

It is instructive to note that Theorem [3] implies that if the integer solution re¬ 
turned by subroutine A does not violate constraints (1161) , then the current master 
solution is optimal. Exploiting this fact, we can use the ellipsoid method to solve 
problem (15) — (18) to certify a polynomial runtime which might be of theoret¬ 
ical interest. To use the ellipsoid method, we need to implement a separation 
oracle. Recall that a separation oracle, given a solution, either confirms that it 
is a feasible solution, or returns the constraint violated by the solution. Using 
subroutine A as the separation oracle, as long as we find a violated constraint, 
we cut the current ellipsoid and continue. When the subroutine A cannot return 
a violating constraint, according to Theorem [31 the algorithm has reached the 
optimum. 


6 Application of the Method in Mechanism Design 

6.1 The Framework Proposed by Lavi and Swamy 

Let X = G R." I Ax < b & a; > 0} denote the underlying polytope of a 
linear program, and x* denote an optimal solution to the program with respect 
to some cost vector. The maximum ratio between the value of an integer pro¬ 
gram and its relaxation, with respect to all cost vectors, is called the integrality 
gap of the relaxation. Assuming that, the integrality gap of A is /3 > 1, and 
that a {3 integrality-gap-verifier is given, Lavi and Swamy propose a method to 
decompose the scaled-down fractional solution ^ into a convex combination of 
integer solutions [13]. A P integrality-gap-verifier is an algorithm that, given any 
cost vector, returns an integer solution whose value is at least 1//3 times the 
optimal relaxed solution. 

This decomposition technique was originally observed by Carr and Vempala 
|2], and later adapted by Lavi and Swamy to mechanism design problems pro¬ 
vided that the underlying polytope of the relaxation of the problem has the 
packing property m- The approach requires only a polynomial number of calls 
to the integrality-gap-verifier with respect to the number of positive components 
in X* . Yet, the approach strongly relies on the ellipsoid method, and hence it is 
more of theoretical importance than of practical use. 

In order to view the LS framework in our setting, the integrality-gap-verifier 
is used as subroutine A and A//3 = {a: | /3a: e A} is treated as P in our setting 
introduced in Section |2j This way, the integer DW finds the maximum value 
in A//3 as well as its decomposition into integer points, both in one step. This 
improves upon other implementations of the LS framework which require two 
steps to find the convex decomposition mm- 

It is instructive to note that solving program (9) — (13), essentially defines a 
Maximal-In-Distributional-Range (MIDR) allocation rule. An MIDR algorithm 
fixes a set of distributions over feasible solutions (the distributional range) inde¬ 
pendently of the valuations reported by the self-interested players, and outputs 
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a random sample from the distribution that maximizes expected (reported) wel¬ 
fare [7]. Here, we optimize over a range which is independent of bidder’s private 
information. The range is in fact the feasible region of the program: all proba¬ 
bility distributions over integer solutions which satisfy constraints (10) — (13). 
The range is obviously independent of bidders’ valuations. 

6.2 Existing Fractional Point 

Sometimes a fractional point a:* S Q is present, and we wish to find a convex 
decomposition of x* into extreme points of Q. This can happen when we use 
other methods to find a fractional point rather than linear programming. Recall, 
we assume that Q satisfy the packing property. 

For this case, we can use the integer DW as follows. Define P = {a: G 
K." |a;<a;*&a;>0} and let c — x*. Now, apply the integer DW. All 
arguments follow accordingly, assuming that a subroutine A with the following 
property is available. Subroutine A will return for any cost vector c an integer 
point X G (5 such that cX > cx*. Because the number of constraints in P is at 
most n, the resulting convex decomposition in this case is tight in terms of the 
number of integer points, according to the Caratheodory’s theorem. 

7 Numerical Example for Integer DW 

In this section, we apply the integer DW to an instance of multi-unit auctions 
to see how the method works. We relegate the details to the appendix. 
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A Numerical Example for Integer DW 

In this section, we focus on applying the integer DW to an instance of multi-unit 
auctions. In multi-unit auctions, there is a set of m identical items and a set of 
players. Each player i has a valuation for any number of items denoted by Vi{j) 
for getting j items where 1 < j < m. The goal is to maximize social welfare by 
distributing items among bidders. 

The LP relaxation for this class of problems is as follows. Let Xij denote if j 
units is assigned to bidder i. 


Maximize E v^{j)x,J (MU-P) 

'i-d 

subject to ^ Xij < 1 for each player i (20) 

3 

'^j-Xij<m ( 21 ) 

0 < Xij < 1 for each i,j (22) 


Lavi and Swamy present a greedy algorithm which returns for any valuation 
V an integer solution that is at least as good as half of the optimal fractional 
solution to MU-P with respect to v [T3]. Thus, we have a 2 integrality-gap-verifier 
algorithm for MU-P. This greedy algorithm will serve as the subroutine in the 
integer DW, and is called A. 

We give a short example to demonstrate the proposed convex decomposition 
method. Suppose a simple multi-unit auction with 3 players and 4 identical items. 
The following valuation vectors Vi (j ) are given for each player i and quantity j: 

j 12 3 4 

vi{j) = { 6 6 6 6 ) 

V 2 U) = ( 1 446 ) 
vsU) = ( 0111 ) 
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We can reproduce program (9) —(13) for this instance as follows. Let X denote 
the index set of integer points which satisfy inequalities (20) — (22). 



■0.5' 


T 1110000000 O' 

Let c = [6 6 6 6 1 4 4 6 0 1 1 1 ], 6 = 

0.5 

, and A = 

000011110000 

0.5 

000000001111 


_ 2 _ 


_1 2341234123 4, 


Notice the integrality gap has been reflected in defining b. 


Initialization Step 

Let the starting basis consist of s and Aq where Xq = 0 is the starting integer 
point. Therefore, the first simplex tableau is as the following. 



BASIS INVERSE 

RHS 

2 

0 

0 

0 

0 

0 

0 

Si 

1 

0 

0 

0 

0 

.5 

S2 

0 

1 

0 

0 

0 

.5 

S 3 

0 

0 

1 

0 

0 

.5 

S4 

0 

0 

0 

1 

0 

2 

Ao 

0 

0 

0 

0 

1 

1 


Iteration 1 

SUBPROBLEM. From the simplex tableau, we have w = [O 0 0 O] and 0 = 0. 
As a result, wA + c = c. The subproblem therefore is maxjgxcXj. Subroutine 
A returns X such that Xu = X 22 = 1 and all other entries of X are zero. The 
objective of the point with respect to current cost is z — c = 10 > 0. Let us call 
this point Xi. 


MASTER PROBLEM. 


AXi 


r 

1 

0 

3 


. Then yi = B ^ 


AXi 

1 


1 

1 

0 

3 

1 


Now, we insert the column into the foregoing tableau and pivot. Variable si 
leaves the basis and Ai enters the basis. 



BASIS INVERSE 

RHS 

Ai 

2 

0 

0 

0 

0 

0 

0 

10 

Si 

1 

0 

0 

0 

0 

.5 

1 

S2 

0 

1 

0 

0 

0 

.5 

1 

S 3 

0 

0 

1 

0 

0 

.5 

0 

S4 

0 

0 

0 

1 

0 

2 

3 

Ao 

0 

0 

0 

0 

1 

1 

1 


After pivoting we obtain the following tableau. 
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BASIS INVERSE 

RHS 

2 

-10 

0 

0 

0 

0 

-5 

Ai 

1 

0 

0 

0 

0 

.5 

S2 

-1 

1 

0 

0 

0 

0 

S 3 

0 

0 

1 

0 

0 

.5 

S4 

-3 

0 

0 

1 

0 

.5 

Ao 

-1 

0 

0 

0 

1 

.5 


The best-known feasible solution of the overall problem is given by AqXq -I- 
AiXi = 0.5Xo -I- 0.5Xi. The current objective value is 5. 


Iteration 2 

SUBPROBLEM. From the simplex tableau, we have w = [—10 0 0 O] and a = 0. 
As a result, wA + c= [—4 —4 —4 —4 1446011 1]. The subproblem therefore 
is maxj^x{wA + c)Xj. Subroutine A returns X such that X 24 = 1 and all other 
entries of X are zero. The objective of the point with respect to current cost is 
2 ; — c = 6 > 0. Let us call this point X 2 . 

MASTER PROBLEM. 


AX2 


'O' 

1 

0 

4 


. Then 7/2 = JB ^ 


AX2 

1 


0 

1 

0 

4 

1 


Now, we insert the column into the foregoing tableau and pivot. Variable S 2 
leaves the basis and A 2 enters the basis. 



BASIS INVERSE 

RHS 

A 2 


-10 

0 

0 

0 

0 

-5 

6 

Ai 

1 

0 

0 

0 

0 

.5 

0 

S2 

-1 

1 

0 

0 

0 

0 

1 

S 3 

0 

0 

1 

0 

0 

.5 

0 

S4 

-3 

0 

0 

1 

0 

.5 

4 

Ao 

-1 

0 

0 

0 

1 

.5 

1 


After pivoting we obtain the following tableau. 



BASIS INVERSE 

RHS 

2 

-4 

-6 

0 

0 

0 

-5 

Ai 

1 

0 

0 

0 

0 

.5 

A 2 

-1 

1 

0 

0 

0 

0 

S 3 

0 

0 

1 

0 

0 

.5 

S4 

1 

-4 

0 

1 

0 

.5 

Ao 

0 

-1 

0 

0 

1 

.5 


The best-known feasible solution of the overall problem is given by AqXq -I- 
AiXi = 0.5Xo -I- 0 . 5 X 1 . The current objective value is 5. 
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Iteration 3 

SUBPROBLEM. From the simplex tableau, we have w = [—4 —6 0 O] and a = 
0. As a result, wA + c = [2 2 2 2 —5 —2 —2 0 0 1 1 l]. The subproblem therefore 
is maxjgx('*^A + c)Xj. Subroutine A returns X such that Xu = 1, X32 = 1 and 
all other entries of X are zero. The objective of the point with respect to current 
cost is z — c = 3 > 0. Let us call this point X3. 

MASTER PROBLEM. 




■ 1 ■ 

'F 



0 


AX 3 


- i 


. Then y2 = B ^ 



1 

1 


1 





L J 


4 

.3. 

1 




1 


Now, we insert the column into the foregoing tableau and pivot. Variable S 4 
leaves the basis and A 3 enters the basis. 



BASIS INVERSE 

RHS 

CO 

z 

-4 

-6 

0 

0 

0 

-5 

3 

Ai 

1 

0 

0 

0 

0 

.5 

1 

A2 

-1 

1 

0 

0 

0 

0 

-1 

S 3 

0 

0 

1 

0 

0 

.5 

1 

S4 

1 

-4 

0 

1 

0 

.5 

4 

Ao 

0 

-1 

0 

0 

1 

.5 

1 


After pivoting we obtain the following tableau. 



BASIS INVERSE 

RHS 

z 

-4.75 

-3 

0 

-.75 

0 

-5.375 

Ai 

.75 

1 

0 

-.25 

0 

.375 

A2 

-.75 

0 

0 

.25 

0 

.125 

S 3 

-.25 

1 

1 

-.25 

0 

.375 

A3 

.25 

-1 

0 

.25 

0 

.125 

Ao 

-.25 

0 

0 

-.25 

1 

.375 


The best-known feasible solution of the overall problem is given by AoXq-I-AiXi-I- 
A 2 X 2 -I- A3X3 = 0 . 375 X 0 -I- 0 . 375 X 1 -I- 0 . 125 X 2 -I- 0 . 125 X 3 . The current objective 
value is 5.375. 


Iteration 4 

SUBPROBLEM. From the simplex tableau, we have w = [—4.75 —3 0 —.75] 
and a = 0. As a result, 

wA + c= [.5 -.25 -1 -1.75 -2.75 -.5 -1.25 0 -.75 -.5 -1.25 -2]. The sub¬ 
problem therefore is maxjgx('*^A -|- c)'Kj. Subroutine A returns X such that 
Xii = 1 and all other entries of X are zero. The objective of the point with 
respect to current cost isz — c=0.5>0. Let us call this point X4. 


MASTER PROBLEM. 
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AX4 


r 

0 

0 

1 


. Then y 2 = B ^ 


AX4 

1 


.5 

-.5 

-.5 

.5 

.5 


Now, we insert the column into the foregoing tableau and pivot. Variable A 3 
leaves the basis and A 4 enters the basis. 



BASIS INVERSE 

RHS 

A4 

2 

-4.75 

-3 

0 - 

-.75 

0 

-5.375 

.5 

Ai 

.75 

1 

0 - 

-.25 

0 

.375 

.5 

A2 

-.75 

0 

0 

.25 

0 

.125 

-.5 

S3 

-.25 

1 

1 - 

-.25 

0 

.375 

-.5 

A3 

.25 

-1 

0 

.25 

0 

.125 

A 

Ao 

-.25 

0 

0 - 

-.25 

1 

.375 

.5 


After pivoting we obtain the following tableau. 



BASIS INVERSE 

RHS 

2 

-5 

-2 

0 

-1 

0 

-5.5 

Ai 

.5 

-2 

0 

-.5 

0 

.25 

A2 

-.5 

-1 

0 

.5 

0 

.25 

S3 

0 

0 

1 

0 

0 

.5 

A4 

.5 

-2 

0 

.5 

0 

.25 

Ao 

-.5 

1 

0 

-.5 

1 

.25 


The best-known feasible solution of the overall problem is given by AoXq-I-AiXi-I- 
A2X2 -I-A4X4 = 0 . 25 Xo -I-0.25X1 -1-0.25X2 -1-0.25X4. The current objective value 
is 5 . 5 . 


Iteration 5 

SUBPROBLEM. From the simplex tableau, we have w = [—5 —2 0 —l] and 
a = 0. As a result, 

wA + c = [—6 —7 —8 —9 —3 —4 —5 —6 —1 —2 —3 —4]. The subproblem there¬ 
fore is maxjgx('*^A -|- c)'Kj. Subroutine A returns X = 0. The objective of the 
point with respect to current cost is z — c = 0. Therefore, the algorithm termi¬ 
nates. Our final solution is as follows. 


Xii 


■f 


O' 


■f 


O' 


'0.5' 

3^22 

= 0.25 

1 

-kO.25 

0 

-f 0.25 

0 

-kO.25 

0 


0.25 

_X24_ 


0 


1 


0 


0 


0.25 


A simple examination shows that x* is in fact one half (scaled down by the 
integrality gap) of the optimal solution to MU-P for our instance. 



